A Plot Understanding System on Reference to Both Image and Language

نویسندگان

  • Norihiro Abe
  • Itsuya Soga
  • Saburo Tsuji
چکیده

In this paper, a system is described that can understand a plot of a story on reference to both image and linguistic information. As input, a series of line drawings with colors and narrations in English concerning to these drawings are given to the system. It searches the objects suggested to be in the scene by the narrations, finding relations among them, making the world model by using its world knowledge. Its refernce to those drawings makes it easy for system to analize complicated structures in the narration sentences such as those of prepositions, and guides the process reasoning about the CD representation using rules and demons. At the end of this paper, a result on QA will be shown.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Reduced-Reference Image Quality Assessment based on saliency region extraction

In this paper, a novel saliency theory based RR-IQA metric is introduced. As the human visual system is sensitive to the salient region, evaluating the image quality based on the salient region could increase the accuracy of the algorithm. In order to extract the salient regions, we use blob decomposition (BD) tool as a texture component descriptor. A new method for blob decomposition is propos...

متن کامل

Language Learning and Language Teaching:Episodes of the Lives of Six EFL Teachers in Iran

Teachers are the most important players of every educational system in different societies; accordingly, understanding their personal reflections may help us gain valuable insights into what it means to be a teacher in a specific cultural and social context. The purpose of this case study was to investigate the life and career of 6 non-native English speaking teachers in state educational syste...

متن کامل

Detection of Coastline Using Satellite Image-Processing Technique

Extended abstract 1- Introduction  Coasts maintain their natural sustainability without human intervention and in spite of short-term changes, we are ultimately confronted with a coastal healthy environment, i.e. natural, rocky beaches, sandy beaches and so on. Today's use of remote sensing in most natural sciences is widespread. Due to the fact that fieldwork is costly and time-consuming, ...

متن کامل

Public Schools and Private Language Institutes: Any Differences in Students’ L2 Motivational Self System?

To enrich our understanding of the attitudinal/motivational basis of foreign language learning at junior high school level, this study investigated the students’ status of L2 motivation, the relationship between motivational factors, and the possibility of predicting their motivated learning behavior in light of Dörnyei’s (2005, 2009) theory of L2 Motivational Self System. To this end, 1462 jun...

متن کامل

The Study of Image by Aby Warburg

Warburg is one of the most inspiring figures in the German tradition of art historiography. Although one of the well-known aspects of Warburg’s intellectual work is its relation to iconology, this article seeks to go beyond the conventional understanding of Warburg to mapping a picture of his “special” view of the image as a whole. To this end, by re-reading the classic Warburg texts and new in...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1981